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1. Introduction 
1.1. Motivations 



The theory of empirical processes has been extensively investigated over the past 
decades. Several authors (see Deheuvels (0), Csorgo and Revesz (0), Stute (US)) 
have underlined its relevance to the study of kernel nonparametric functional 
estimators, such as the Parzen- Rosenblatt density function estimator (refer to 



Parzen (|22l ) and Rosenblatt (j2J)), or the Nadaraya- Watson regression func- 
tion estimator (see, e.g., Nadaraya (|2ll ) and Watson (33,)). Lately, these results 
have been significantly extended by, especially, Einmahl and Mason (15), 



Mason Deheuvels and Mason ifisl ) and Varron Isi]). By combining empir- 
ical process arguments with combinatorial techniques initiated by Vapnik and 
Cervonenkis ((jsol). 113)), these authors have estabhshed various versions of the 
uniform consistency of kernel type estimators, the latter being also shown to 
hold uniformly over the bandwidth parameter, with some restrictions. A direct 
statistical application of these results is given by the construction of limiting 
certainty hands for the density and the regression functions (see, e.g., Deheuvels 
and Mason (flsh). A parallel field of study is that of quantile processes, for which 
a series of functional limit laws have been provided by Deheuvels and Mason 
111) and Deheuvels (S). The motivation of the present study is that the re- 
cent refinements of the functional limit laws, initiated by Deheuvels, J. Einmahl, 
U. Einmahl and Mason, have been mostly written in the framework of the usual 
empirical (distribution) processes, and cover only in part the case of quantile 
processes. We will therefore orient our work towards bridging the remaining 
gaps in this theory. As a main result, we shall provide, in the sequel, a uniform 
in bandwidth functional limit law of the logarithm for the increments of the 
normed quantile processes. This result will be then applied to establish a uni- 
form in bandwidth law of the logarithm for Nearest-Neighbor density function 
estimators. In this particular framework, we recall that such uniform in band- 
width results are particularly helpful to derive similar properties for estimators 
based on data-driven (and then random) bandwidths (see, for instance, (flsh ). 
We also mention that our results should be useful in the construction of non- 
parametric goodness- of -fit tests (see, e.g.. Theorem 13.21 below) . Likewise, some 
applications to the study of Lorenz process and score function estimators, in the 
spirit of Csorgo (@), may be derived from our results. We refer to Csorgo (@) for 
other examples of applications of quantile processes, which have some relevance 
to our work. 



1.2. Notation and main Results 

Let Xi, X2, ■ • • be independent and identically distributed [iid] random variables 
with distribution function F{x) := P(Xi < x), for x € IR, and quantile function 
Q{t) := M{x > : F{x) > t}, for < t < 1. For x e M, we denote by 
Fn{x) :— n^^]jf{Xi < x,l < i < n} the empirical distribution function based 
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upon Xi, ■ ■■ ,Xn and by Qn{t) := inf{a; G H : Fn{x) > t}, for < i < 1, the 
corresponding empirical quantile function. Here ft-B denotes the cardinality of 
E. We denote by a„(a;) := n^/^{Fn{x) — F{x)), for a; € H, the empirical process 
of order n > 1, and we let (see, e.g., Csorgo ^) 

hn{t):^n^'''{Qn{t)~Q{t))/q{t) for < i < 1, (1.1) 

denote the normed quantile process. Here, 

stands for the quantile density function (see, e.g., Parzen fi^)), and 

m - iFixi 

denotes the probability density function, both assumed to be properly defined 
and continuous in domains specified later on (see, e.g., the assumptions (F.l- 
2) below). In this paper, we are concerned with limit laws for the increments 
■(9„(-) of the normed quantile process &«(•); which are defined as follows. Given 
< i < 1 and a bandwidth he (0, i A (1 - t)), we set 

dn{t, h, s) bn{t + hs) - &„(t), for s e [-1, 1]. (1.3) 

We will let /i > vary in such a way that h'^^ < h < /i", where {/iJi}n>i and 
{h'^}n>i are two sequences of positive constants such that < h'^ < h'^ < 1 
and, for either choice of /i„ = h'^ or ft,„ — /i", the conditions (i?. 1-2-3) below 
are fulfilled by {/i„}n>i. Set, for x £ 1R+, logj a; :— log^ log^ x, and log_|^ a; := 
log(x V e). We assume that 

(iJ.l) /i„ i and nhn t oo as n ^ oo; 

(iJ.2) log(l//i„)/ log2 ri oo a.s n ^ oo; 

(7J.3) nhn/ logn — s- cx) as n — s- oo. 

In addition, we will say that the sequences {/i^}ri>i and {^"}n>i, with < /ijj < 
/i^ < 1, for n > 1, fulfill the assumption (HA) if at least one of the conditions 
{HA){i), {HA){ii) below are satisfied. 

{HA){l) ^ on as n ^ on; 

logn^loga^ 



{HA)(ii) —— — — — — = o(- asn^oo. 

K^oeO-IK) Vlogn/ 

Remark 1.1. (i) Note that, under (iJ.1-2), the hypothesis {HA)(i) is satisfied 
whenever (_ff.3'), introduced below, is satisfied. 

{H.3') n^^^h'j^/ \ogn oo as n oo. 
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Obviously {H.3') is a stronger condition than (iJ.3). 

(ii ) For the particular choices h',^ — n^*" and h'^ — n^*, for n > I, with 
< s < r < 1, the hypothesis {HA){ii) is satisfied whenever s < r < (1 + s)/2. 

(iii) Our main results are established under the hypotheses (i?.l-2-3-4). How- 
ever, it is unlikely that (HA) is necessary, and these results may still hold under 
the only hypotheses {HA-2-3) (see Remark\4-.2\ in the sequel). 



We now specify the range of t in ()1.3p . We define the endpoints ui and U2 of 
the random variable Xi as follows 

— oo < Ml := inf{x : F{x) > 0} and oo > U2 := sup{x : F{x) < 1}. (1-4) 

Further introduce en,h '■= h + 25n^^ logj n, with h E [ft,^, /i"]. We will work on 
intervals of the form [ti^n,h,t2,n,h] with ti^nM = SnM and t2^n,h = 1 - e„,/i. 

We will assume that the following conditions hold. 

(FA) F is twice continuously differentiable on J :~ (ui,U2); 

(F.2) F' = f is strictly positive on J; 

(F.3) sup^^^,,^^^{F{u){l-F{u))\f{u)\)/f^{u)<j, for some 7 > 0. 
It is noteworthy that the inequality in (-F.3) is equivalent to 

o<t<i J {Q[t)) 

Some more notation is needed for the statement of our results. Denote by §0i the, 
so-called, Strassen set, a variant of which having been introduced by Strassen 
(I25I ) in the framework of the law of the iterated logarithm for partial sums. 
Here, §0 is the unit ball of the reproducing kernel Hilbert space pertaining to 
the two-sided standard Wiener process {W{s) : \s\ < 1}. The latter process is 
conveniently defined by setting 

Wi{s) fors>0, 
W2{-s) for s < 0, 



W{s) = 

where Wi and W2 are independent standard Wiener processes. We have, namely. 



§0 = {g e AC(-1,1), .g(0) = and J 3(5)^^5 < l|, 

where AC{—1, 1) stands for the set of all absolutely continuous functions g on 
[—1, 1], with Lebesgue derivative g. We denote by S(— 1, 1) the set of all bounded 
functions on [—1,1] and set, for any g e S(— 1,1), ||,g|| := sup_i<3<i |(7(s)|. 
Finally, we set, for any e > 0, E>q — {h E B{—1, 1) : infggSg \\g — h\\ < e}. Our 
main result may now be stated as follows. 
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Theorem 1.1. Let {/iii}n>i o,nd {/i"}n>i be two non-random sequences fulfill- 
ing the conditions (i7.1-2-3-4), with < h'^ < h'^ < 1. Then, under (i^.1-2-3), 
we have, almost surely. 



lim sup 



sup 

,h<t<*2 



inf 

geso 



dn{h,t-.) 



= 0. 



(1.5) 



Moreover, for each pair of constants ci, C2 with < Ci < C2 < 1, we have, almost 
surely. 



yg E So, lim sup 



inf 



y/2h\0g{l/h) 



= 0. 



(1.6) 



Remark 1.2. Extensions of Theorem \1.1\ can be obtained by making sharper 
assumptions upon the distribution function F. In particular, ti^n,h o-nd t2,n,h 
may be replaced in U.5\) by h and 1 — h respectively, when working under the 
additional assumptions (i^.4-5) below. 

(FA) Ai = limuim f{u) < oo, A2 = lim„|„2 /("") < 
{F.5) min(yli, ^2) > 0. 

It is noteworthy that assumptions (i^.1-2 -3-4-5) define particular tail monotone 
density functions with exponent 7, as defined by Parzen (2Si). Other less restric- 
tive assumptions may lead to alternate extensions of Theorem \l.l\ We refer the 
reader to Csdrgo (6) for more details. 

The proof of Theorem 11.11 is postponed until Section [D A rough outline of 
our arguments is as follows. First, we establish, in Section [2l a version of this 
theorem for iid uniform (0,1) random variables corresponding to the case where 
f{x) ~ I[o,i](a;) and q{t) = I[o^i](t) (see, e.g., Theorem 12.11 below). Then, we 
make use of a continuity argument to treat the general framework. In Section 
[3] we present some statistical applications of our results. Section 2] is devoted to 
the proofs of our theorems. Finally, in the Appendix, we provide details on a 
technical fact used in Section |4l 



2. The Uniform Case 



Let Ui, U2, ■ ■ ■ , be iid uniform (0, 1) random variables. In this context, we denote 
by Un{t) ■— n^^jjt {Ui < t,l < i < n}, for t G M, the (right-continuous) empirical 
distribution function, and by Vn{t) := inf {u>0: C/„(u) > t}, for < t < 1, 
with Vn{t) = for t < and Vn{t) = Ki(l) for t > 1, the (left-continuous) 
empirical quantile function. Here, ]),E denotes the cardinality of E. We define the 
uniform empirical process based upon Ui, ■ ■ ■ ,Un by a„(t) := n^/^ (Unit) — t) 
for i g R, and the corresponding uniform quantile process 



l3nit):=n^/^{Vn{t)-t) for t e M. 



(2.1) 
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Note that, in this setup, the quantile process is equal to the normed quantile 
process, since, as was already pointed out, q{t) — I[o^i](t). Define further, for 
any < t < 1 and h £ [0, t A (1 — t)], the increment functions 



^„(/i, t\ s) := an{t + hs) - an{t), 
C„(/i,t;s) := I3n{t + hs)~ Pr.{t), 



(2.2) 
(2.3) 



for — 1 < s < 1. The limiting behavior of the maximal oscillations of these 
processes has been extensively investigated in the literature (see, e.g., Stute 
(26), Deheuvels and Mason (11), (jH), Deheuvels (0), Deheuvels and Einmahl 
(fldf). Mason iflii). and the references therein). 

We are now ready to state, in Theorem 12. li a version of Theorem 11.11 for one- 
dimensional uniform (0, 1) random variables. It is noteworthy that Theorem l2.1l 
is somehow stronger than Theorem 11.11 in the sense that it holds on a larger 
interval (compare (jl.Sp and (|2.4p below). 

Theorem 2.1. Let {h'^}n>i and {/i"}n>i be two non-random sequences fulfill- 
ing the conditions (iJ.1-2-3-4), with < /i^ < /i" < 1. Then we have, almost 
surely, 



lim sup < sup inf 

he[h',^,h'A] I h<t<l-h \a<^^o 



Cn{h,t; .) 



y/2h\og{l/h) 



= 0. 



(2.4) 



Moreover, for any pair of constants ci, C2 with < ci < C2 < 1, we have, almost 
surely. 



V5 e So, lim sup < inf 

he[h'„.h','^ I ci<i<C2 



Cn{h,t; 



^2h\ogil/h) 



= 0. 



(2.5) 



The following corollary of Theorem 12.11 will be instrumental in the proof of 
Theorem ll.il postponed until Section [42l 



Corollary 2.1. Under the assumptions of Theorem \2.1[ we have, almost surely 



lim sup 



I sup ( 

"1 h<t<l-h ^ - 



sup 

1<S<1 



\Qn{h,t-s)\ 

^2h\og{l/h) 



= 1. 



(2.6) 



The proof of Theorem 12.11 is postponed until Section 14.11 An outline of our 
forthcoming arguments is as follows. First, we will establish, in Proposition 14. II 
below, a version of this result for ^„(/i, i;-). Proposition 14.11 will be shown to 
follow from Theorem 1.1 of Varron (31). Given this first result. Theorem 12. II is 
straightforward under {HA){i), and, to establish Theorem 12.11 under {HA){ii), 
we will base the remainder of our proof on a uniform-in-bandwidth Bahadur- 
Kiefer -typ e representation of Cn in terms of ^„ (see, e.g., Bahadur ([l|), Kiefer 
(flil ). (17) and Deheuvels and Mason (fl^ ). This representation is captured in 
Lemma ITT] in the sequel. 



V. Viallon/ Functional limit law for the increments of the quantile process 



502 



3. Some Applications 
3.1. The k-Spacings 

In this sub-section, we provide some consequences of the just-given Theorems 
II. H and [2.11 The details of the corresponding proofs are postponed to Section |4l 

We first consider the uniform case and denote by [/(i) < . . . < [/(„) the order 
statistics pertaining to a random sample Ui, . . . , C/„ of iid uniform (0,1) random 
variables. The k-spacings of C/(i) < ... < [/(„) are then defined by 

^i,n{k) '■= U(^k^i) — U(^i) for fc=l,...,n and i = 0, . . . , n + 1 — fc, (3.1) 

where [/(q) ■— ^^^id C/(„+i) :~ 1. For any integer 1 < d < n, we set 

(5„((i) max max Ai„(fc) — fc/71. (3.2) 

l<k<d 0<i<n+l-k I ' ^ ' ' I 

The following Theorem 13 . 1 1 will be shown to follow from Theorem l2.1l Set \x] > 
X > \x~\ — 1 the ceiling function of x e JR. 

Theorem 3.1. Let {^Ji}n>i o,nd {^"}ri>i be two non-random sequences fulfill- 
ing the conditions (i?.l-2-3-4), with < h'^ < h'^ < 1. Then, we have, almost 
surely, 

r y/n 5n{\nh']) 

lim sup — — = 1. (3.3) 

he[h'^M'A] ^y2h\og{^/h) 



The proof of Theorem 13.11 is given in Section 14.41 

We now turn our attention to the case of possibly non-uniform random vari- 
ables. Let ^(1) < . . . < ^(n) be the order statistics pertaining to a random 
sample Xi, . . . , Xn, of iid random variables with common distribution function 
F, density function / and quantile function Q. Let ei^' = 25n^^ log2 and 
introduce the quantities ii_„ and i2,k,n defined as follows 

ii.n mm{i : - > e'^^} (3.4) 

n 

i -\- k 

i2,k,n ■= max{i : < 1 - e\l^}. (3.5) 

n 

Under the hypotheses (K 1-2-3), define the k-spacings of X(i) < . . . < -^(n) by 
setting, for fc = 1, . . . , n and i = ii^„, ii,„ -I- 1, ... , ii,k,n, 

Dun{k) ■■= X(^k+i) - ^(i)- (3.6) 

Note that the k-spacings £'i.„(fc) could obviously be defined for k — 1, ...,n and 
i — 0, ...,n — k. However, the restriction we propose here is needed to derive 
Theorem I3.2[ presented below, from Theorem ll.il 

For any integer 1 < d < n, we set 

k 

dn{d) := max max /(X(,)) A,n(fc) 77T^ • (3-7) 

i<k<d ii,„<i<i2,f!,7i n J yJ*!. (^i-^ ) 
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The following Theorem l3. 21 provides a complement to Theorem 1 of Csorgo and 
Revesz (0). 

Theorem 3.2. Let {h'^}n>i md {^"}n>i be two non-random sequences fulfill- 
ing the conditions (iJ.1-2-3-4), with Q < h'^ < /i" < 1. Then, under (i^.1-2-3), 
we have, almost surely, 

,• ^ dniSnh}) 

lim sup = 1. (3.8) 

"^^^ he[h'^ji'^\ y/2h\og{l/h) 

As mentioned above, Theorem l3.2l will be shown to be a consequence of Theorem 
11.11 because of the well known relation Qn{t) — ^(i) for (i — 1)/?t. < t < i/n. Its 
complete proof is postponed to Section 14.31 



3.2. A Law of the Logarithm for Nearest-Neighbor Density 
Estimators 

In this sub-section, we show that the results of the Sub-section 13.11 imply a 
uniform-in-bandwidth law of the logarithm for a nearest-neighbor nonparamet- 
ric density estimator. Let, as in Sub-section 13. li ^(i) < . . . < -^{n) be the 
order statistics pertaining to a random sample Xi , . . . , Xn of iid variables with 
distribution function F, density function F' = f and quantile function Q. Fix 
< ti < i2 < 1 and define the random sequences 

Ul^n := Qn(il), M2,ri := Qn{t2), " > 1, (3.9) 

where Qn stands, as in Sub-section ll.2[ for the empirical quantile function. Note 
that the fact that q{t) — -^Q{t) exists and defines a positive and continuous 
function on (0, 1) is a consequence of (jl.2p and (|1.4p . when combined with the 
assumptions (F.1-2-3). Thus, for n large enough, we have m < mi,„ < U2,,i < U2 
almost surely, where ui and U2 are defined in ()1.4|) . 

Further introduce K, an arbitrary kernel on M, that is a measurable function 
integrating to one on M, and denote by {A:^}n>i and {A:"}„>i two sequences such 
that {h'^}n>i and {/i"}ri>i fulfill the conditions (i/.l-2-3-4), with h'^^ = k',^/n 
and /i" — k[[/n, for n > 1. Select fc > such that fc € [fc^, /c"]. On the interval 
[wi,„, U2,n], define the k nearest-neighbor empirical density function, based upon 
the kernel K and the sample Xi, . . . , Xn , by 

where 

Rk{x) := inf{7' > 0, such that exactly [fcj elements of the sample 

Xi, . . . , Xn are in [x — r/2, x + r/2]}. 

This random function is often referred to as the adaptative variable bandwidth of 
order k. The following additional assumptions upon the kernel K will be needed 
to state our result concerning nearest-neighbor density estimators. 
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{K.A) K is of bounded variation on M. 
(K.B) K is compactly supported. 

Theorem 3.3. Let {hn}n>i and {h'^}n>i be two non-random sequences fulfill- 
ing the conditions (iJ. 1-2-3-4), with < /ij^ < /i" < 1. Set, for n> 1, k!^ = nh'^ 
and k'^ = nh'^. Then, under (F. 1-2-3) and (K.A-B), we have, almost surely. 



Vk \f„,k{x) - E/„^fe(a 
v/2/2(x)log(n/fcT" 

where and U2,n are defined in i3.9\) . 



lim sup sup 



K 



R 



\t)dt'^ 



1/2 



(3.11) 



Remark 3.1. Note that, in the setting of density estimation, the hypothesis 
{HA){i) generally holds, since most of the bandwidth selection procedures lead 
to choices like /i^ — cin~°' , for a given < ci < oo, with a < 1/2. 



We will show, in the forthcoming Section 14.51 that Theorem 13.31 is a natural 
consequence of a combination of Corollary 2.1 of Varron (|32i). with Theorem 
13.21 We mention that Theorem 1.1 of Varron (j3ll ) may be adapted likewise to 
obtain a similar result as that stated in Theorem 13. 3( in the case of the usual 
Parzen-Rosenblatt (see, e.g., Parzen and Rosenblatt ([H)) kernel density 
estimator (see Facts 15.11 and 15.21 in the Appendix) . 



4. Proofs 

4.1. Proof of Theorem [Q 

We first establish the analogue of Theorem 1 2. II for Recall the definition (|2.2p 
of 

Proposition 4.1. Let {h[-^}„>i and {/i"}„>i be two non-random sequences ful- 
filling the conditions {HA-2-3), with < h'^ < /i" < 1. Then, with probability 
one, 

^n{h,t; .) 
^2h\og{l/h) 

Moreover, for any pair of constants < ci < C2 < 1 , we have, almost surely. 



lim sup < sup inf 

"^°°/ie[/i;,h/;] I h<t<i-h \9&o 



9 



0. 



(4.1) 



V5 G So, lim sup < inf 



^n{h,t; 



^2h\og{l/h) 



9 



0. 



(4.2) 



Note that the hypotheses (i?. 1-2-3) are sufficient in Proposition 14. II 
Proof. Set 



Gn {I 



[(t/\{t+v)},(ty(t+v))]: 



h e ft."], h<t<l-h, -h<v<h} 



and 



g:={l[,,y},0<x<l,0<y<l} 



(4.3) 
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It is well known that the class of all closed intervals in IR forms a VC class (see, 
e.g., van der Vaart and Wellner (|28l)). Therefore, making use of the result of 
Exercise 9 on page 151 of van der Vaart and Wellner (j28l ). it is readily shown 
that Q constitutes a FC-subgraph class of functions (we refer to Section 2.6.2 
in van der Vaart and Wellner (|28l ) for the definitions of VC classes of sets, and 
y C-subgraph classes of functions) . Therefore Q satisfies the entropy condition 
{HK.III){i) given in the Appendix, and since Qn C Q, the equation (|4.2p is a 
direct consequence of Theorem 1 . 1 of Varron ((sih (which is recalled in Fact 15.11 
in the Appendix for convenience). The same arguments readily show that, for 
each < A < 1/2 and e > 0, there exists almost surely an n[e) such that, for 
all n > n{e), 

{UK t;.):he <], t e [A, 1 - A]} C §g. (4.4) 

Our proof is completed by the observation that IJi :— [{Ui + X) modulo 1] and Ui 
are identically distributed. Thus, for n large enough, we have the distributional 
identities 

{UM;.) ■.heK,h';^],te[h,X]}^^^^ 

^{Uh,t;.):heK,h:],te[X,2X-h]}^^^, 

and 

{Uh,t;.):h€ K, K], i e [1 - A, 1 - 

^{Uh,t;.):he K,h':^],te[l~2X,l-X-h]}„>i. 

By combining these statements with (14. 4p . we obtain, in turn, that for each 
e > 0, there exists almost surely an ri(e), such that for all n > n{e), 

{UKt;.):heK,K],te[h,X]}ciSl 

and 

{Uh,t; .) : h e K,h':^],t e [1 - X,l - h]} dSl 
The proof of proposition 14. II in now complete. □ 



Remark 4.1. We note that Corollary 3 of MasonjlM) , which is a d-variate ex- 
tension of Theorem 3.1 of Deheuvels and Mason (IM), can be established through 
these arguments. 

The completion of the proof of Theorem 12.11 under the hypothesis (_ff.4)(i) is 
now straightforward. Indeed, Kiefer (16) showed that, almost surely as n — > oo, 

sup K(o+/3„(oi-0( ^^°^"^'''!;?^^''\ 

o<t<i ^ n'^' ' 

which implies that uniformly over h e h < t < 1 — h and \s\ < 1, we 

have almost surely as n — > oo, 

Uh,t;s) _ -Uh,t;s) / (logn)^/^(log2 »)^/S 
^2hlogil/h) ^2h\ogil/h) Ul/4(/ilog(l//i))l/2 
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and 

Uh,t-s) ^ -Uh,t-s) / (logn)V^(log2n)i/S 
^2h\og{l/h) ^2h\og{llh) Vni/4(/jlog(l//^))i/2 

These two last results, when combined with Proposition 14. 1[ are enough to 
establish Theorem 12. II under the hypothesis {HA){i). 

To prove Theorem 12.11 under the hypothesis {HA){ii), we will work under the 
following notation. We will set \\g\\+ '■— supQ<g<]^ \gi-'')\ foi' the sup-norm of 
a function g G ;B(0, 1), in contrast with \\g\\ = sup_2<s<i |g(s)|, used when 
g G B{—1, 1). To simplify matters, we will give proofs of our theorems with the 
formal replacement of 1 1 . 1 1 by 1 1 . 1 1 + . The technicalities needed to switch from 1 1 . | ] + 
to ||.|| are straightforward, but lengthy, and will therefore be omitted. 

The completion of the proof of Theorem 12.11 under the hypothesis {HA){ii) 
will require a uniform-in-bandwidth Bahadur-Kiefer-type representation of Cn 
in terms of The following two lemmas are oriented towards the aim of es- 
tablishing a representation of the kind. Our forthcoming results mimick that 
obtained by Deheuvels and Mason |l^. in a slightly more general setup of 
varying bandwidths. We give the details of their proofs for the sake of com- 
pleteness. 



Lemma 4.1. Let {h'^}n>i o.nd {/i"}ri>i &e two sequences fulfilling the condi- 
tions (iJ.1-2-3) and {HA){ii). Then, for any A > 1, we have, almost surely, 

lim sup sup \\Uh,t;-HUh,Vn(ty,.)U_^ (4 3) 

he[h'^,h'^]a<t<i-\h ^2/ilog(l//i) 

where Vn{-) is still the empirical quantile function. 

Proof. Choose any h € with A>1, 0<t<l-A/i and < s < 1. 

Observe that 

Cn{h, t- S) + ^n{h, Vnit);s) = {C„(/l, t; S) + an{Vn{t + hs)) - aniVnit))} 

+ {aniVnit) + hs) - an{Vn{t + hs))} . (4.6) 

Making use of the easily proven fact that \Un{Vn{t)) — t\ < 1/n for any n > 1 
and < i < 1, an application of the triangle inequality to the right-hand side 
of (|4.6p estabhshes, in turn, that, uniformly over h G [h'^, h'J,], < t < 1 — Xh 
and < s < 1, 

\Cn{h, t; s) + {a„(K(t + hs)) - W)}l < '^n'^'^- (4.7) 



We invoke Theorem l(III) in Mason (|l8l ) to obtain that, whenever {/i''}n>i 
satisfies (iJ. 1-2-3), we have 

,. ^\Vn{t + h)-Vn{t)-h\ ^ 

Imi sup sup ^ = 1 a.s. . 

Q<h<h'^ 0<t<l-h V log(l/'ln) 
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Thus, for any e > 0, we have, almost surely for all n sufficiently large, uniformly 
over h e [h[^, /iJ'J, < t < 1 - A/i and < s < 1, 

\Vn{t + hs)-Vn{t)^hs\<v^ := (l + £)2(27i-i<log(l/<J)'/'. (4.8) 

We next observe that, if the sequence {h'^}n>i satisfies, ultimately as n ^ oo, 
the assumptions (i/. 1-2-3), then, such is also the case for (u„)„>i in (14. 8p . The 
first half of Proposition 14. f [ implies therefore that 

,• \an{Vn{u)) - an{Vn{u) + v)\ 

limsup sup sup ^ i± < I g (-4 gj 

n^oo o<-u<-L>„ o<y„(ti)<i— L>„ -y/2u„ log (1 /■;;„) 

(Note that v in plays the role of hs in ([iTTjl V 
Now, observe that, since > 1} satisfies (i?.l-2-3), we have 

1/2 < liminf (log(l/u„))/logn < limsup (log(l/-L'„)) /log n < 1. (4.10) 

By combining (|4.8p with (|4.9p and (|4.10p . we get that, for all n sufficiently large, 
sup sup sup n^'^ {h';^\og{l/K)y^'^ {Xogny^/^ 

he[h'^Ji'^\ 0<t<l-\h 0<s<l 

X |a„ {Vn{t + M) - (K^(^) + Ml < 2^/''(l + e) a.s. 

Since e > can be chosen arbitrarily small in the above inequality, we see that, 
almost surely, 

limsup sup sup sup n^^^ (/i^ log(l//iJ^)) ^^"^ (log n)~^/^ 

n^oo h£[h'^,h'^\0<t<l-\hO<s<l 

X |a„ (K(i + hs)) - a„ (14(0 + Ml < 2'/^ (4.11) 

Under the hypothesis {HA){ii)^ (14. lip , when combined with (|4.6p and (|4.7p . 
suffices to complete the proof of (|4.5p . □ 



Remark 4.2. /t is likely that the following result holds : for any sequences 
{/i^}„>i and {hj[}n>i fulfilling the hypotheses {H.l-2-5), 

y \Vn{t + hs)-V„(t)-hs\ ^ ^ 

hm sup sup sup — < 1 a.s. . (4.12) 

^" ;ie[/i^,/!/;] o<t<i-/io<s<i ^y2hlog{l/h) 



n — >oc 



If so, following the same lines as above, it could be shown that the result of 
Lemma \4. 1\ and, consequently, the results of Theorems COl \3.Si and \3.3\. 
would still hold under the only hypotheses {H. 1-2-3) . 

Lemma 4.2. Let {^'i}n>i cind {ft-"}n>i be two sequences, assumed, each, to 
fulfill the conditions {H.1-2-3) and {H.A){ii). Then, for any fixed X > 1, we have 
almost surely 

V IICn(fe,t;-)+e»(fe,l-/t;-)||+ 7/, lo^ 

limsup sup sup = <2\/A-l, (4.13) 

n^oo h^[h'^,h'^]l-Xh<t<l-h y/2h\og{l/h) 
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and for all n sufficiently large, uniformly over h e [h'^, h'^], 

K(l -Xh) <l-h. 



(4.14) 



Proof. By setting, respectively, t = h, s = —1 in Proposition UTj and t = 0,s 
1 in Lemma |4. 11 we obtain readily that, with probability one. 



limsup sup ±Pn{h)/\/2hlog{l/h) < I. 

n— »oo hG[h'^^,h'^] 

Thus, under {H.1-2-3), we have, almost surely, 

lim sup {Vn{l~Xh)-{l-h))/h = l-X<0. 



(4.15) 



Set LOn(a) :~ supQ<j<]^_^ {||^„(a, t; .)||+} for < a < 1. From Proposition 14.11 
we have sup^gj^, j^,,-^{ujn{h) / y^2hlog{l/h)} 1 almost surely as n ^ oo. By 
combining this result with (|4.15[) . we obtain that 



lim sup sup sup 

n-+oo hem^Ji'^] l~\h<t<l-h 



\\Uh,Vn{t);-)~UhA-h;-)\ 

^2h\ogil/h) 

2^„((A - l)h) /7^^ 
sup — = = 2^ (A - 1) a.s. 



In view of (|4.5p . this last result readily yields (|4.13p . whereas (|4.14l) is a direct 
consequence of (|4.15p . □ 

We are now ready to complete the proof of Theorem 12.11 To establish (|2.4p , we 
fix an £ > 0, and choose A = 1 + jg. In view of (|4.13p . (I4.14p . Proposition 14. II 
and (|4.5p . there exists almost surely an A^^ < oo, such that, for all n> N^, 

Vn{l — Xh) < 1 — h uniformly over h G [/i^, h'^], 



and 



sup < sup inf 

h£[h'^,h'^] {n<t<i~h\a&^t> 



y/2h\0g{l/h) 



sup < sup 

he[h',^Ji'^] I 0<t<l-A/i 



sup < sup 



\Cn{h,t;-)+^n{h,Vn{t)r)\\ + 
^2hlogil/h) 
\\Cn{h,t;-)+Uh,l-h;-)\\ + 



^2h\og{l/h) 

Therefore, for all n > N^, we have, with probability one, 

Cn{h,t; •) 



< e/2 a.s. , 

< e/2 a.s. , (4.16) 
< e/2 a.s. 



sup < sup I inf 

he\h' ,h"] ^ 0<t<l-/i ^seSo 



^2hlog{l/h) 



)} 



< e. 
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This last result suffices for the proof of the version of \2A\ obtained with ||.||_|_ 
replacing ||.||. The proof of the version of (|2.4p making use of the sup-norm ||.|| 
follows along the same lines and is therefore omitted. 

To establish (|2.5p . we first select an arbitrary g £ Sq and fix a e > 0. By 
there exist almost surely an ni''^ and a sequence tn^ G (1/4,3/4), n = 1,2, 
such that, for all n> rie , 



sup II Uh,t^n^; .)/ V2/ilog(l/M - g || + < £/4. 

h&[h'^,h'J^] 

Now set tn — Un{tn^) for 71 > 1. We have, uniformly over h e [/ijj, /i"], 



(4.17) 



Cn (^7 tn^'i •) 



^2h\og{l/h) 



< 



\Cn{h,tn;-) +Cn{h,Vn{tny,-)\\ 



^2h\og{l/h) 



II -e«(^,K(^n);-)+e.(fe,tW;.)| 
^2h\0g{l/h) 



^2h\og{l/h) 



(4.18) 



The Glivenko-Cantelli theorem, when combined with the definition t„ = Unitn"^) 
of tn, with tn'' G (1/4,3/4), readily implies that, almost surely for all n suffi- 
ciently large, tn e (1/8,7/8) and Vn{tn) < < Vn{tn + l/n). This, in turn, 
entails that (see, e.g., Deheuvels ^) 



\imsup\Vn{tn) — tl^''\{n/ \ogn) = 1 a.s. 



(4.19) 



Set pn '■— logn/n for n > 1. By Theorem 1(1) of Mason, Shorack and Wellner 
(|20(). it follows that (see, e.g., (2.17) in Deheuvels and Mason (12)) 



sup 



sup 



0<t'<l-p„ |t'-t"|<2p„ log" 



Unit') - Unit") - Oil) a.s. 



By combining this last result with (|4.19|) and the fact that, under the hypotheses 
(i?.l-2-3), log nj \Jnh log(l/ K) uniformly in /i g as n ^ oo, we 

readily obtain that 

limsup sup \\-UKVnitn)v)^UKt'^v)\\. ^ (4,20) 

n^oo h^\h'^M^\ ^/2/ll0g(l//l) 

By (|4.16p . (|4.17p and (I4.20p . there exists almost surely an iV^ < cx), such that, 
for all n > N^, we have 1/8 < i„ < 7/8, t„ < 1 - A/i" and 



sup 



Cn (^5 ; ■) 



V2/ilog(l//z) 



(-.9) 



< s. 



(4.21) 
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By choosing e > arbitrarily small in ()4.2ip . we obtain readily (|2.5p with 
ci = 1/4 and C2 — 3/4. The extension to arbitrary < ci < C2 < 1 follows 
from the same lines and is then omitted for the sake of conciseness. This last 
result completes the proof of the version of Theorem 12.11 pertaining to the sup- 
norm ||.|| + . The extension to the case of ||.|| is straightforward, and hence also 
omitted. □ 



4.2. Proof of Theorem [777] 

Recall that Qn{t) — Q{Vn{t)) for < t < 1. Keep in mind that the fact that 
q{t) = -^Q{t) exists, and defines a positive and continuous function on (0, 1), is 
a consequence of (II. 2p and (|1.4p . when combined with the assumptions (F.1-2- 
3). In view of the definitions (|l.ip - (|2.ip of 6„ and /3„, this, when combined with 
Taylor's formula, entails, almost surely for all n sufficiently large, the existence 
of a Ot^n G (i A Vnit),t V Vnit)) for each t e (0, 1), such that 

^W. "'^'<0''^-<';'-OW) ^;,„W%l. ,4,22) 

q{t) q{t) 



Thanks to this relation, Csorgo and Revesz 



showed that, under the assump- 



tions 1-2-3) (see also Theorem 3.2.1 in (|6D) 

'log2"-' 



sup |5„(t)-/3„(i)| 



almost surely, (4.23) 



with ei^'' = 25n ^ logj n. The result of Theorem 1 1 . 1 1 directly follows by combin- 
ing Theorem O with (g^S]). 



4.3. Proof of Theorem 

Recall the definition of 5„(<) = n^/'^{Qn{t)-Q[t))/q[t), where Q„(i) = 
for [i — l)/n < t < i/n. Thus, for any < s,t < 1, setting i = \nt\ and 
j — \ns~\ , where \x~\ > x > \x~\ — 1 is the ceiling function, we have Qnis) = X^j-^ , 
Qn{t) = ^(j), and 



L q{s) q{t) ) 

^q{s) 



,1/2 



{Q{s) - Q{t))) + (Qnis) - Q{s)) (^4 - l) }■ 
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This allows us to write 



bn{s) ~ bn{t) 



where 



(X(,-)-X(,)-Q(^)-Q(^))+£„(t,. 



(4.24) 



£„(i,s) := £i,„(t, s) -e2,n(i,s), (4.25) 
£i,„(i,s) (Q„(s)-Q(s))(^-l), 

e2,„(i,5) Q(s)-Q(t)-(g(^)-Q(^)). 

Since (z — l)/rt < t < i/n and (j — 1)/7t. < s < j/n, the assumptions (F.l— 2) 
readily imply that, 

|Q(s)-Q(-)| < \s^-\q{si) < ^ for some si € ((j - l)/n, j/n), 



and, similarly, 

|Q(i) - Q(-)\ <\t- -\q{ti) < for some h G ((i - l)/n, z/n). 

n ' n n 



It follows therefore that we have, uniformly over h € ultimately as 

n oo, 

sup sup \£2n{t,t + hu)\ —Oi — ] a.s. . (4-26) 

To evaluate ei,n(i, f + ftu), we will make use of the following fact, due to Csorgo 
and Revesz (0) (see also Lemma 1.4.1 in Csorgo ^)). 

Fact 4.1. Under (_Fl-2-3-4), we have, for every yi,y2 G (0, 1), 
9(2/2) _ fiQivi)) < f (2/1 V ya) „ 1 - (yi A ^2) 



9(2/1) /(Q(2/2)) " I (2/1 A y2) 1 - (2/1 V 2/2) J ' 
where j > is as in (i^.3). 

Under (F.3), it follows readily from Fact 14. II that, for it > and as ft. — > 0, 



q{t + hu) 



l=0{h^). (4.27) 



Similarly, for u < 0, one can show that ^(1^ - 1 = 0{h^) as /i -> 0. In 
addition, by the Chung (Q) law of the iterated logarithm [LIL] applied to the 
sup-norm of we observe that, almost surely as n — > cx), 



0<t<l 



-1/^ sup |/3„(t)|=o(Ji^). (4.28) 



V. Viallon/ Functional limit law for the increments of the quantile process 512 

We now combine (|4?27l) with ([422]) and (|4?28l) . We so obtain that we have, with 
probabihty 1, uniformly over h G [/i^, /i"] and uhimately as n — > oo, 



sup 



sup \£iJt,t + hu)\^o{h^\r^^^^']. (4.29) 
3<u<i V V n / 



Recall that {i~ l)/n, < t < i/n in (|4.24p . A Taylor expansion based upon (F.l), 
together with the Chung (0) LIL, as stated in (|4.28[) . and (|4.22l) . shows readily 
that, almost surely as n ^ oo, 

|/(Q(t))-/(X(,))| = \fiQ{t))-fiQnm=o{\Qit)~Qnit)\ 

= o(|Q(t)_Q(l)|)+o(Q(l)-Q„(l) 

Set 

dW(d):= max max A,„(A) - (Q(^) - Q(-)) |, 

i<k<d Ji,„<i<i2,fc,n n n ' 

where we recall that 

ii,n = min{i : - > e^,^^} 
n 

r • ^" ^ ^ 1 
*2,n = maxji : <l-<^}, 

with ei^^ = 25n~^ log2 n. Observe that, for all ft, G [/i^, /i"] and every iijnh^,n ^ 

i < «2,n, 



(^,-1, Qn{t) = (4.31) 

V n nJ 



3t e 



n n 

'i ~ 1 i 



(- ,-],Qn{t + h) = X(,+ r„ft]), (4.32) 



n n 
'i ~ I i 



$te(- ,-],Qnit + h) = X(,+ r„,,^+i). (4.33) 



Now, looking carefully at the arguments used in the proof of Theorems 11.11 and 
12.11 it is straightforward that the following results hold. Under the assumptions 
of Theorem 11.11 we have, almost surely, 

hm sup I sup f sup (4 34) 

helh',^M-] ^o<.<i v/2/ilog(l/ft)/J 

In view of ^i^-^^, (jiTM)) entails that 

r \V^4Pi\nh])\ 

hm sup = 1 a.s. . (4.35) 

helh'„,h'^] ^/2h\og{l/h) 
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We conclude by routine analysis that, under _ff.(l-2-3) and the assumptions 
above, (|4.35p holds with the formal replacement of di^"* by This completes 
the proof of Theorem 13.21 

4.4. Proof of Theorem [XT] 



Recall the definition ()2.1|) of /3„. Following the lines of the above-given proof of 
Theorem 13. 2[ we select < s,t < 1 and set i = \nt\ and j = \ns~\. We then 
write 

Pnit) - Pnis) = n'/^(^(u^f) - U^,) - ^) + ^ - (t - s)), (4.36) 
and observe that, in (|4.36[) . 

j - -i 



(t^s) <-. (4.37) 
n 

In view of (|4.36p and (|4.37p . we obtain the proof of (|3.3p by similar arguments 
as in the proof of Theorem 13.21 

4.5. Proof of Theorem[3lM 

The Parzen- Rosenblatt kernel estimator of the density function / (see, e.g., 
Parzen ((23 ) and Rosenblatt (HJ) is defined, for some kernel K fulfilling {K.A- 
B), and a positive bandwidth h, by 



1 " 



nh 

i=l 



X - Xi 



Recall the notation J = (mi, M2). An application of Theorem 1.1 of Varron lj3lr ) 
(see Facts 15.11 and 15.21 in the Appendix) yields readily the following proposi- 
tion whose proof is omitted. This proposition pro vides a uniform-in-bandwidth 
version of Corollary 4 in Einmahl and Mason (|l4l). 

Proposition 4.2. Denote by a sub-interval of J with non-empty interior. 
Let {/i^}n>i and {/i"}„>i be two non-random sequences fulfilling the conditions 
{H. 1-2-3) ^with 0<h'„<h'^<l. Then, under (F.1-2-3) and (K.A-B), we have, 
almost surely, 



...pVn/.|/„,.(x)-E/„,.(x)| r f (4.38) 



To complete the proof of Theorem 13.31 we select two sequences {ft.^}n>i and 
{h'^}n>i fulfilling the conditions (iJ.1-2-3-4), and set fc'j — nh'„ and fc" = nh'^. 
Given this notation, we claim that, almost surely as n —^ 00, 

k 

sup sup \Rkix) TTtI^^- (4.39) 
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To see how (|4.39|) follows from Theorem 13.21 select x € [wi.„,U2,n] and let 
i = ik{x) be the smallest mteger for which > x — Rk{x)/2. Then, at least 
one of the relations 

^(j)-^ 2~' ^0"+LfeJ-i) -•^ + — 2~ 

holds. This naturally implies that 

Rkix) < max { [X^+LfeJ) - ^U)] ' [^b+LfeJ-i) " ^(i-i)] }' 

and 

Moreover, observe that, for all x' e [X(^j_^_^k\-i)T ^(j+[ki+i)]: f{x') = f{x) + o{l) 
almost surely as n ^ oo, for all k e [A:^, fc"]. Putting all these results together, 
we can apply Theorem 13.21 and conclude to (|4.39p . 

Now, introduce the modified sequences defined by 

h' I ~ I 1 

— ^infTTT ^^^^ < 2/i''sup-— . (4.40) 

We infer from (|4.39p and (|4.40p that, almost surely as n — *■ oo, 

h'^< inf inf Rkix) < sup sup Rkix) <K. (4.41) 

a;e[jji,„,«2.„] ke[k'^,k'^\ 2;e[«i_„,U2,„] ke[k'^^.k',[\ 

Recalling from (i^.1-2) that / is bounded and strictly positive on J, with J D 
[wi_„,it2,ra] for all n > 1, we see that {h'^}n>i [resp. {ft."}n>i] fulfills (if.1-2- 
3-4), whenever such is the case for {h'^i}n>i [resp. {/i"}n>i]- Moreover, setting 
ui = Qiti) and U2 — Q(^2), we have U£,„ — > u^, for £ = 1,2 almost surely as 
n ^ oo and ui > ui and U2 < U2 (by (F.l— 2)). Thus, in view of Proposition 
14. 2[ it is straightforward that, under the hypotheses of Theorem 13. 3[ 



r Vfc /«,fc(a^) - E/«,fc(a^) ^ ( f j^2,,^,.\ 
lim sup sup — - < \ I K it)dt \ 



xe[ui,„,y.2,,t]ke[k'^,k'^] yj2pix) log(n/fc) Wr 



Vfc |/„,fc(a;)-E/„,fe(a:)| ^ f /" ,^2..^ ..1 

(4.42) 

Moreover, in view of (|4.39p . for all fc„ = n/i„ e [fc^n^^^], it holds that, almost 
surely as n ^ oo, 

inf < inf Rk^x) < sup i?fc„ (a;) < 2/i„ sup 
x&j J[x) i a:e[iii,„,«2.„] xe[Mi„,«2„] xej J[x) 

We now compare (|4.43l) with the condition (-B.1) in Deheuvels and Mason (jl3l ). 
The fact that 

1- Vfc^ |/n,fe„(a;) - E/„,fe„(x)| r /■ 

lim sup ' , V ^ I / K^it)dt\ (4.44) 

"^°^a:6[«i,„,u2,„] ^fiPix) log(n/fc„) Ur J 
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follows from Proposition 14.21 in view of (|4.39p and (|4.4ip . along the same lines 
as the first part of Theorem 1.2 in Deheuvels and Mason (flsh is shown to be 
a consequence of their Corollary 3.2. We omit the details of this book-keeping 
argument. 

By combining (|4.42p with (|4.44p . the proof of Theorem (|3.3p is readily achieved. 

Acknowledgments: We thank the referees for careful reading of our manuscript 
and for insightful comments leading, in particular, to some extensions of our 
original Thcorem ll.il 



5. Appendix 
5.1. Useful facts 

Here we present two necessary facts, that have been shown to be instrumental 
in our proofs. 

Fix 0? > 1. Let (Zi)i>i be a sequence of iid random variables defined on M'', and 
5 be a class of real Borel functions defined on H''. For each /i > 0, n > 1 and 
z g R'', we set 



G„(if,/i,z) -.^Y.^ 



i=l 



where K ^ Q. 
Further set 



[0, 1]'', \u\ := maxi<j<rf \ui\ and 
J" := {/V (A(z - .)), z e R'', A > 0, X e ^j. 
Introduce the following assumptions on Q. 

(HK.I) (i) lim|u|^o sup/^gg J^, {K{x)-K{x + u)ydx = Q. 

(a) limA^i sup^gg {K{Xx) - K{x))^dx = 0. 
{HK.II) (z) e g, sup^gR. \K{x)\ < 1. 

(ii) yK e Vx ^ K{x) = 0. 
{HK.III) {i) 3 C> 0,1; > 0,V < e < 1, Af{e,T) < Ce-^ 

(ii) T is pointwise separable. 

Here J\f{£,J-) := sup{A/'(e, J^, L2(P)), P probability measure} denotes the uni- 
form covering number of for e and the class of norms {L2(P)}, with P varying 
in the set of all probability measures on (for more details we refer to van 
der Vaart and Wellner (j2^, pp 83-84). 

Let B{Q) denote the set of all real bounded functions on C/, continuous with re- 
spect to pointwise convergence. Let ^2{'3) be the Hilbert subspace of L2(]R'', m) 
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spanned by Q (here, m denotes the Lebesgue measure on R'*). For / e L2(]R'^) = 



L2(]R''), denote by ^/(g) ■— if,g) — \J J fgdm, g € G, the inner product in 
L2{Il'',r7i) and J(^/) := J^d f^dm the squared norm of / in L2(]R'^,m). For 
each 5' e B{G) that can not be expressed as a 5*/, / e h2(Si'^), we set J(5') — oo. 
Finally, set K := : J(*) < 1}. 

The following result is due to Varron (jsH ) (see also Varron (Hll)). 



Fact 5.1. Let {/i'i}n>i a?^c? {^n}n>i ^wo sequences of positive constants, 
fulfilling the assumptions {H.1-2-3), and such that < /ijj < ft," < 1. Suppose 
that Zi has a density function f , such that the following conditions hold. For 
some compact set H e H"*, there exists a > such that f is continuous and 
strictly positive on 



:= {x G R"^' : inf lice — z||]Rd 



Here, |l.||Rd denotes the usual Euclidean norm on R''. Then, if Q is a class of 
real Borel functions satisfying {HK.I-II-III), we have almost surely. 



lim sup sup inf 

e K, lim sup inf 



G„(.,/i,z) 



^2fiz)nhlogil/h) 
Gn{., h, z) 



^2f{z)nhlogil/h) 



- * 



0, 



= 0, 



where HV'llg = sup^^g \->P{K)\. 

A direct consequence of this result is as follows (see, e.g., Varron (js^)). 

Fact 5.2. Let K be a measurable kernel of bounded variation, with compact 
support. Under the relevant assumptions of Fact [5.1[ we have, almost surely. 



lim sup sup 



nh\fn{K,x,h) -'EfniK,x,h)\ 



^2f{x)\og{\/h) 

1 " z Z 

where fn{K, x,h) = — ^k(^ 




K^dm, 
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